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PREFACE 


This  report  derives  the  optimum  likelihood  ratio  receiver  for  detecting  the 
presence  of  a Gaussian  noise  like  signal  masked  by  a baekgn)und  of  Gaussian  noise. 
Two  channels  of  information  are  used  to  include  the  effect  of  a directive  signal 
source.  The  mathematics  of  this  problem  is  considered  in  some  detail  since  it  is 
applicable  to  the  active  sonar  problem  as  well  as  the  passive  problem.  The  report 
is  written  for  the  reader  who  has  not  iK'en  exposed  to  the  spatial  processing  problem 
but  does  have  the  necessary  background  in  detection  theory.  For  the  more  advanced 
reader  wishing  to  pursue  this  topic,  the  report  by  Van  Trees^^nd  the  paper  by 


Edelblute.^ct  al.  are  highly  recommended.  ^ 


The  author  wishes  to  express  his  appreciation  to  Mr.  D.  Edelblute  for  his 
help  with  the  matrix  algebra  and,  particularly,  to  Dr.  H.L.  Van  Trees  for  providing 
the  necessary  problem  perspective.  > 
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REVERSE  SIDE  BLANK 


INl’KOinCTlON 


Tho  optiiiumi  dotoc-tion  probU'iii  to  lx*  exaniinod  in  this  report  is  shown  in 
figuro  1.  The  waveldrnis  rj(t)  and  r.,(t)  an'  observMi  at  two  spatially  separaU*d 
points  for  a finite  time  duration  T.  and  we  an'  asked  to  design  the  optimuni  receiver 
under  the  two  hypotheses,  "signal  plus  noise”  (Hj)  or  ”noisi‘  only' 


r,(t) 

r.,(t) 


s(t)  t Iljtt) 
sd  - t)  t n.j(t) 


(la) 


r,(t) 

r.,(t) 


n,(t) 

n.,(t) 


(lb) 


The  target  signal  s(t)  appearing  on  channel  one  is  a menitx-‘r  function  from 
a stationary,  zero-mean,  (lau.ssian  random  process.  Bi'cause  of  the  spatial  scpara- 
titxi  Ix'tween  channels,  the  Uirget  signal  appearing  on  channel  two  is  delayed  by 
T seconds  and  is  s(t-T).  Physically,  t is  related  to  the  target  tearing  angle  which 
is  assunu'd  to  te  constant  during  the  observation  interval.  This  implies  t is  fixed. 

The  noise  processes  nj(t)  and  ngtt)  appearing  on  channels  one  and  two. 
respectively,  are  stationary,  zero-mean,  Gaussian  random  processes  that  are 
statistically  dependent,  but  assumed  to  be  statistically  independent  of  the  target 
signal  processes.  Thus,  the  problem  formulated  is  the  two  channel  Gauss  signal 
in  Gauss  noise  problem  with  dependent  noise  between  channels. 


HYDROPHONE# 


HYDROPHONE^ 


OPTIMI'M 

DETECTOR 


fl,  DECISIO.NS 


t„iT 


Fifiur*'  I.  Tuo  ('hannt’l  Dt'tcrt i<yn  Prohlvm. 
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and  require  that  the  exjH'cU'd  \’alue  of  the  mean-square  difference  ijetween  signal 
and  its  representation 


N 

2 

E 

/, 

r(t)  - ^ Rj  (;ij(t) 

dt 

L i=i  J 

converge  to  zero  for  teI  = ltg.tQ*T]  as  the  number  of  terms  N-^ac.  A consequence 
of  requiring  mean-square  convergence  is  that  the  coefficients  in  the  expansion  will 
be  obtained  from 


:*(t)  dt 


(3a) 


where  the  set  of  basis  functions  !(pj(t)l  have  the  proix'ity  that  they  are  orthonormal 


6,j  - fi't)  9j*(t)  dt 


(3b) 


The  choice  of  a particular  l!p,(t)i  to  ensure  convergence  is  due  to  Karhunen  and  Loeve 
and  requires  solutions  to  the  integral  ecpiation 


K^(t.u)  <p*(ii)  du  Ajtpj  (t) 


(4a) 


where  the  covariance  is  defined  as 

K|.(t.u)  K{|r(t)  - m(t)l  |r(u)  - iiiiii)]} 


( lb) 


2 


I 


A partKiihirly  iisel'iil  proiK'ity  of  the  Kurhiinen-laK-ve  lepreseiitatiiui  is  that 
the  ehoiee  retiuired  hy  equation  (Ju)  leads  to  a set  of  eoidlieients  11{|1 

whieh  are  uneorrelated 

KIK.RfMA,6,.  <01 


Since  the  processes  we  are  dealing  with  are  Gaussian,  and  furthermore,  the  mapping 
to  obtain  the  coefficients  ns  given  by  equation  (3a)  is  linear,  then  the  set  IRji  must 
be  jointly  Gaussian  random  variables;  hence,  the  uncorrelatedness  of  the  coefficients 
implies  statistical  independence  as  well. 

The  foregoing  discussion  of  our  choice  for  a vector  space  is  the  correct  way 
to  deal  with  the  problem.  However,  a numter  of  practical  problems  arise  which  must 
be  dealt  with.  The  most  difficult  of  these  is  the  requirement  for  finding  solutions 
to  the  integral  equation  given  by  equation  (4a).  That  is,  from  knowledge  of  the 
covariance  function,  find  the  basis  vectors,  lifjtt)!.  The  additional  requirement  ol 
letting  N ->  O'-  is  prohibitive  if  we  intend  to  calculate  IR,!  for  use  in  the  optimum 
detection  system.  .Motivated  by  the.se  two  practical  problems,  we  will  choose  the 
set  of  basis  vectors  to  bo 


tq)„(t)i  = leJ"“o'i  ((j) 

where  co„  = 2tt/T  and  n - 0,  ±1,  +2.  . . . ±.V.  Thus,  we  have  chosen  a truncated  Fourier 
representation.  From  equation  (2a). 


r(t)  - Y R(ncon)  e<""o'  (7a) 

-Nuo 


and  from  equation  (3a) 


R(nco,J  f r(t)  e j'’“ot  dt  (7b) 

0 q'  J-r'2 


which  is  the  complex  spectral  component  at  frequency  iicoq.  Obviously,  the  choice 
of  thi'  Fourier  basis  will  not.  in  general,  provide  solutions  to  the  Karhunen-Lobve 
intt'gral  equation,  and.  conversely,  insure  complete  representation  of  the  random 
process.  Also,  choosing  the  Fourier  basis  does  not  insure  that  the  variables  re- 
main uncorrelated.  With  these  factors  in  mind,  let  us  take  the  integral  pnxluct 
defined  by  equation  (7b).  We  then  have  the  set  of  complex  Fourier  c<x'fficients 
forming  the  random  vectors  Rj  and  R2  for  channels  one  and  two.  respectively; 


K,(cOu) 


H,(C0|) 


lyco,) 


with  co^j  Nco,j;  C0|  -Ncojj;  aiui 


1 r T/2 

I Tjd)  dt  i = l,2 

‘ “ T J-T/2  ‘ 


The  desired  property  that  the  e(x>fTicients  be  uncorrelated 


E!Ri(oo^)  Rj(w„)!  = 0 


i.j  - 1.2 


for  different  frequencies  is  examined  in  the  .Appendix.  It  is  shown  there  that 
uncorrelatedness  holds  if  and  only  if  (a)  the  process  is  periodic;  that  is. 

K (t-u)  = K (t  - u ‘ T)  or  (b)  the  observation  interval  becomes  very  long;  T->oc. 


LIKELIHOOD  RATIO  TEST:  A ( R , , R., ) 


Having  established  a way  to  convert  functions  of  time  into  sots  of  numl)ers. 
our  attention  is  turned  to  deriving  the  likelihocxi  ratio.  That  the  likelihood  ratio  is 
a sufficient  scalar  statistic  for  either  the  Hayes  or  the  .Neyman-Hearson  criterion  is 
well  known."*  Hence,  wi-  Ix'gin  directly  by  defining  the  likelihood  ratio  as 


\(R,.  R.,) 


ptRpRo  H,i 
plR,.  R;;  : H„1 


the  ratio  ('f  the  joint  proliability  density  functions  conditioned  on  each  hypothesis. 
The  optimum  detector  is  one  which  computes  the  likelihiKid  ratio  and  compares  it 
to  a threshold.  This  rule  is 


\(R,.  R^)  > 7 


Dt'ici-tinn . Est imat ian . and  Modulation  Theory.  Part  I:  H.!.,  \'an  Trees.  -Jnhn  Wi!(\v  nnH 
Sens.  Inc.,  New  York.  N Y..  HU->7.  pp.  24-‘l4. 
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'I'he  choice  of  r/  is  of  course  detX'iident  upon  the  values  and  costs  chosen  for  the 
Bayes  criterion,  or  upon  the  allowable  false  alarm  proliability  in  the  case  ol  the 
Neyman-Pearson  criterion.  The  main  job  remaining  is  to  evaluate  AtRj . R2l'  the 
comparison  to  a threshold  is  trivial. 


Simplification  of  .VlRj,  R.^l 


Rewriting  the  likelihood  ratio  using  the  definition  for  Rj  and  R2  gives 

p{R|(co^j)  R2(c0y)  . . . Rj(coj)  R2l“|l  1 H)  } 


/\(R,.Ro)  = 


p{R,(co^)  R2(co^)  . . . Rjico,)  R2(co,)  I H,,} 


(Ua) 


after  grouping  terms  of  the  same  frequency  and  reordering.  By  Bayes’  rule  this  ma.v 
be  re-written  as 


.\(Rj,R2) 


p{R,(co^)R,,(cOy)  1 . . . Rj(co,)R2(oo,)  : H,}p{.  . . R,(co,)R2(w,)  | Hj 

z — — - (11b) 

p{R,(co^^>R2(co^);  . • . R,(cO|)R2(cO|):  H„}p{.  . . R,(U|)R2<tJ|)  I H,,} 


Since  the  received  process  is  gaussian  under  either  hypothesis  and,  furthermore, 
that  lR(coi)t  arc  gaussian  random  variables  tecause  they  were  obtained  by  the  linear 
operation  of  equation  (8b),  the  probability  distributions  in  equation  (lib)  are  multi- 
variate gaussian.  But,  we  have  already  stated  that  (see  equation  8c)  spectral 
coefficients  at  different  frequencies  are  uncorrelated.  Thus,  since  the  distributions 
are  gaussian,  this  is  equivalent  to  the  coefficients  being  statistically  independent, 
and  equation  (11b)  becomes 

"i}K-  • ■ 

- p{R,(co_^)R2(coJ  : H„}p{.  . . R,(«,)R2(cO|)  H,,] 

^ the  same  reasoning,  successive  application  of  Bayes’  rule  to  the  nmiaining  terms 
./II  itie  far  right  for  each  discrete  fri'quency  in  the  range  will  yield 

p{Rl(«|^)R2(i^k)  1 Hj} 

p{R,(co,)R2(co,)1Ho} 

.fl  a(r,(co,).  R2(co,)) 

k=l 


(13) 


'I'lie  likoliluK)d  ratii)  rt-duces  to  the  prodtift  of  tho  likelihood  ratio  at  each  frequeiicv. 
a useful  simplification  arising  from  uncorrelated  coefficients  for  jointly  gaussian 
random  variables. 

The  crucial  assumptions  for  ecpiation  (13)  to  hold  are: 

(a)  The  process  under  each  hypothesis  must  lx*  gaussian  and  statioruu-y. 

(b)  The  process  must  be  Fourier  expandable  (implying  either  a periodic 
process  or  a long  observation  interval). 

We  state  that  (b)  and  the  assumption  of  stationarity,  may  be  relaxed  if  the 
eigenvectors  in  the  Karhunen-Lobve  expansion  are  used  (a  solution  for  equation  4a 
has  been  found). 

It  remains  now  to  determine  the  numerator  and  denominator  terms  in  equation  13. 
However,  before  this  can  be  done,  we  must  first  define  the  form  of  the  bi-variate, 
complex  Gaussian  distribution  since  tx)th  Rilco^)  and  complex. 


Complex  Bi-variate  Gaussian  Distribution 

Suppressing  the  notation  for  the  specific  frequency  the  pair  of  complex 
random  variables,  defined  as 


Rj  = + ib^ 

R2  = a2  + i b2 


(14a) 


and  having  the  assumed  property  that 

ElRil  = EIR2l  = 0 

with  a covariance  matrix 


2 

o cr 
11  12 


CT  a 
21  22 


(14b) 


(14c) 


where 


11 


E!R,R  ,*! 


rj2  - EiR,R2*i 


02!  EtR2R2*! 

021  E1R2R]*! 


(14d) 


then  the  form  for  the  bivariate  distribution  of  R 


Ri 

R., 


IS 


plR,.R2l  = 


(R,,  H2)*  K' 


I / ‘M 

R., 


exp  - 


(l.'ra) 


'I'ho  inverse  of  the  covariance  matrix  is 


r 2 

■ 

^22 

-^12 

— tr  * 

- a, 2a, 2* 

(lob) 


when  it  is  recognized  that  ^\2  -°2\'  Passing  that  since  8,(82)  and 

b,(b2)  are  two  gaussian  random  variables  which  are  statistically  independent 
(orthogonal  implies  uncorrelated)  then  R,(R2)  is  jointly  gaussian  and  R]i(;R2i) 
is  distributed  Rayleigh  and  arg  R,  (arg  R2)  is  uniformly  distributed.  We  are  now 
prepared  to  evaluate  each  of  the  terms  in  equation  (13). 


Evaluation  of  plR,(co,^), 

I'nder  hypothesis  H„,  the  received  signals  are; 


r,(t)  - n,(t) 


r.,(t)  - n.,(t) 

Finding  the  Fourier  coefficients  with  equation  (7b)  at  a particular  frequency 
obtain  (suppressing  the  notation  for  u>^); 


(Ib) 


“k- 


R,  - N, 
R,  = .N2 


(17) 


The  covariance  matrix  of  the  noise  is; 


°i2 


;,2  U22 


where 


a,,^  = ElN,N,*!  a22^  EI.V^I 
a,2  =E1\,N2*I  a,2*=  EI.W! 


(18n) 


(18b) 


From  the  form  of  the  complex  bi-variate  gaussian  distribution  given  by  equation  (1,5a), 
the  conditional  distribution  under  noise  becomes 


p{R,.R2lHj^ 


1 

exp  - 

1 \ 2 / 

(If)) 


with  K|,  given  by  equation  (18), 


Kvaluatioii  of  pi  K2<co|.)  IIj! 


I'ikUm-  hypothesis  II |.  the  receivinl  sifjiials  are; 

r,(t)  s(t)  4 ii,(t) 
r.,(t)  s(t-  t)  ‘ n.,(t) 

Finding  the  Fourier  coefficients  with  equation  (7b)  at  a particular  frequency 
we  obtain; 


Rj(cO|,)  = S(cO|^)  Njlcoj.) 

R.,(cO[j)  = S(coj^)  e"i“k^  t N2(cJ|^) 


(21a) 


We  wish  to  suppress  the  notation  with  c0|^.  Consider  that  t we  can  rewrite 

(21a)  as 


R,  =S-N, 

R2  = Se-i-T*  N2 


(21b) 


The  covariance  matrix  for  signal  plus  noise  is: 

ElRjR*!  EIRjR2*r 
E)R,R2*!*  E!R2R2*1 

Evaluating  each  term  in  the  matrix  for  Rj  and  R2  given  by  equation  (21b)  and 
knowledge  that  noise  is  independent  of  signal,  we  obtain; 


K,  = K(,  - EISS*! 


e+iT 

1 


(23) 


The  coefficient  of  the  matrix  is  recognized  as  (see  equation  A-16  and  A-19) 

E!S(co^)S*(cO|^)|  = <I>(cO|^)  (24) 

the  signal  power  spectrum  evaluated  at  the  frequency  coj^. 

If  we  define  a column  vector  to  be 


then  equation  23  can  be  written  compactly  as 
K,  - K„  • 1>  VV^ 


(25) 


(2(i) 


H 


with  ( roprosontiiiK  ( , tlu>  traiispusi-  ol'  the  complex  conjciKate. 

From  the  form  of  the  ctmiplex  hi-variate  gaussian  (tistrihutioii  given  by 
equation  (loa),  tlu>  conditional  distribution  under  signal  |)lus  noise  Ix'comes 


plR  K„  H I _1 exp-  (Kp  K^)*  K,-' f'^ 

\«2 


with  K(  given  by  equation  2H. 


Algebraic  Reduttion  of  A (Rj.  R2) 

Returning  to  the  likelihood  ratio  of  equation  13,  and  substituting  for  tx)th 
of  the  conditional  density  functions  given  by  equation  19  and  e<iuation  27,  we  have 


“ 1 I , . 

A(Ri,  R2>  = n TjF  **^1’  -*^0' 


As  is  usually  the  case,  we  note  that  comparing  A(Rp  R2I  b)  a threshold  for  our 
optimum  decisions  is  equivalent  to  comparing  In  AtRj,  R2I  some  other  threshold 
since  exp  - t I is  a monotonic  function  of  its  ctfgunKjnt.  Thus,  we  may  rewrite  our 
decision  rule  of  equation  10  as 


u "1 

V(R,.R2)=^  <«!•  I'^o  ' -K,'!  (r'J  ^ 


with  the  new  threshold 


^ l^ol 
- In  n - > In 


The  term  1K„‘'  - K,''l  can  1h>  rt'duced  algebraically  as  follows.  Substituting 


for  K,  from  ecpiation  2b  gives 


IK,,-'  K,-'l 


'()  "'0 


K„  . <l)  VV^ 


= K„-'  -1K„(I  • <h  K,,-'  VV^ir* 

= K,,-'  -II  . <!>  K,,-'  VV^l''  K,,-' 


9 


We  claim  that  the  IbllowiiiK  identity  is  true 


<h  K,:*  vv^r'  I 


<t> 


1 . (h  K|, ' V 


K,,  ' VV^ 


Cll) 


'I'd  prove  that  this  is  so.  we  require  that  the  rinhthaud  side  of  equation  81.  when 
multiplied  by  the  inverse  of  the  lefthand  side,  yield  the  identity  matrix.  'Phis  is 
demonstrated  for  a somewhat  more  general  case  by  Edelblute.  cl  al.'*  .Substituting 
into  equation  30  gives; 

( 


IK,;'  -k,-M 


S'  - 


<i) 


Kn  ‘ VV^ 


1 • ch  K,; ' V 


1 - <i)  (K,:'  V) 


(K„'  V)(V+  K ■') 


1 * <t)  V) 


(K^'  V)(K,;’  V)"^ 


(32) 


the  last  step  resulting  from  knowledge  that  ' is  hermetian;  K,;'  = (Kp 
inspection  of  equation  (15b).  Substituting  equation  .32  into  equation  (29a)  we  have 
a somewhat  simplified  form  for  the  log  likelihood  ratio; 

U 

V(R,.R2)-^(Ri.R2)* 

k-i 

Recall  that  every  term  inside  the  summation  is  a function  of  cO|^.  By  defining  the 
vectors 


/Ri<“kA 

R(co.)A  ) (34a) 

•<  -\R2K)/ 


-1 


1 - 0 V'^(K„  ' V) 


V)^ 


(33) 


The  loK-likelih(Kxl  ratio  can  be  written  eonipaetly  as 


V(R,.R2)  = J U'Hco^)  Z^o^)Rtco^)l^  IX'Mco^)  R (W(^)l  (35) 

k=^l 

RECEIVER  STRL’CTTRE 

We  may  now  determine  the  form  of  the  optimum  receiver  which  implements 
equation  35.  As  shown  in  figure  2,  the  two  channels  are  Fourier  transformed, 
resulting  in  the  set  of  complex  Fourier  coefficients.  These  are  then  used  to 
compute  the  log-likelihood  ratio  test  statistic.  This  scalar  is  then  compared  to 
a constant  which  is  a function  of  the  signal  power,  the  noise  power,  and  a priori 
probabilities  and  costs.  If  the  number  is  greater  than  this  threshold,  we  make  the 
decision  that  signal  plus  noise  is  in  our  observation  interval;  otherwise  just  noise. 
Thus,  the  receiver  of  figure  2 could  be  implemented  on  a digital  computer  and  the 
hypothesis  test  run  for  each  observation  interval.  There  is,  however,  an  equivalent 
receiver  which  could  Ik'  implemented  using  realizable  time- invariant  filters.  We 
shall  state  the  result  and  then  show  it  is  true. 


Figure  2.  C omputer  Implefneritation  of  Tujo  Channel  Cog'dkelihood  Ratio  Rece  iier. 


AX. 


T 


Wo  claim  that  I'isaro  ,'l  is  the  IVcquoncy  transfbr  representation  for  figure  2. 
Demonstration  that  this  is  true  eenU>rs  on  showing  that  the  test  statistic  a is 
identical  to  A'tRj,  R.,)-  By  inspection  of  figure  the  output  waveform  y(t)  has  a 
discrete  freciueney  function  Ytcoj^l  given  as 

Ytco^l  = A'-(C0|^)|Zj*  (C0|.)  H]  (C0|^)  ■ Z./"  (C0|^)  K2 

In  vector  notation  this  is 

Y(cO|^)  - ^‘'McO|^)  Z^(cO|^)  R (cO|^) 

where 

Z^tco,^)  = lZ,*(co^),  ZgMco,^)] 


cm 


(37a) 


I R,(co. ) 

' Ir2(co^) 


(37b) 


The  continuous  frequency  function  Y(co)  can  bt‘  written  as 

U 

Y(co)  - ^ Y(cO|^)  6 (co  - a3|^) 
k=l 

using  delta  functions.  Similarly,  the  complex  conjugate  Y*(co)  can  lx?  written  1 
u 

Y*(co)  = ^ Y^(co^)  6 (co  - cO|^) 


(38) 


(39) 


k-1 


The  reason  that  the  transpose  is  also  taken  will  become  obvious;  note  that  Y(cO|^) 
is  not  a vector  and,  hence,  the  transpose  has  no  effect. 

Now,  the  test  statistic  a is,  from  figure  3, 


a = f y^(t)  dt 
Jo 

But  from  ParsevaTs  theorem, 

r““  Y(co)l^  df  = f ^ y2(t)  dt 
J coi  Jo 


(40) 


(41) 


(42a) 


\vi'  have,  whi’ii  use  is  niadi'  ol’ equation  .'W  and  I'quation  .‘Ut, 


I Y(co) 


k-  1 


(co.  ) Y'f  (cok)  6(co  - oJk) 


(42b) 


I'sinK  the  definition  t)f  Y(w)  from  equation  (dTa)  and  inteKratiiiK  over  the  raufje  of 
CO  as  indicated  by  equation  41  yields 


U 

a = ^ |A''^(co,.)Z^cO|^)  R (cO;^)]MV-(co^)  (oo^)  R (co,^)  1 

k=l 

which  is  identical  to  (R,,  R.,).  Thus,  the  two  receivers  are  identical. 


(43) 


Sl'MM.ARY 


This  report  considers  a very  special  problem,  the  two  channel  detection 
of  a (laussian  noise-like  signal  masked  by  a background  of  Gaussian  noise.  The 
signal  process  was  related  iK'tween  channels  by  a fixed  lime  delay  and  the  noise 
was  correlated  l)Ctween  chiuinels.  Implicit  in  the  receiver  structure  of  figures  2 
and  3 is  knowledge  of  this  delay,  t.  'I'his  is  because  Zj  (coj^)  and  Z2(c0|j)  are 
functions  of  V(cO|^)  which  in  turn  is  related  to  t ; [see  equation  2o  and  equation  (34b)]. 
Thus,  if  T is  unknown  and  non-random,  we  have  to  first  optimally  estimate  Ttequivalent 
to  l)earing  angle)  and  then  use  this  estimate  in  our  optimum  detector.  It  can  be  shown 
that  if  we  choose  a maximum  a posteriori  estimate,  then  the  cascade  of  this  estimate 
followed  by  the  detector  is  jointly  optimum.  This  problem  will  be  considered  at  a 
future  date  along  with  some  other  more  realistic  models  of  the  signal  process. 

The  choice  of  a Fourier  basis  for  our  vector  space  was  motivated  b.\’  the 
knowledge  that  the  signal  spectral  components  on  channel  two  would  1k»  just  a 
phase  shifted  version  of  those  appeai’ing  on  channel  one,  and,  thereb.v.  greatly 
simplifying  the  mathematics  of  the  problem. 

The  issue  of  how  our  optimum  receiver  ix?rforms  has  Ix^en  left  unresolved 
for  a number  of  reasons.  First,  upon  inspection  of  our  test  statistic  given  by 
equation  43.  we  see  that  it  is  of  the  form 


1 


(44) 


It  is  immediately  apparent  that  a is  not  distributed  gaussian  since  we  are  dealing 
with  the  .squares  of  complex  gaussian  random  variables.  Thus,  determination  of 
how  a is  distributed  under  each  hypothesis  in  order  to  calculate  the  ROC  curves 
is  a difficult  anal.vtical  task.  Furthermore,  it  is  not  clear  that  this  would  give  us 
the  correct  result  since  we  have  truncated  the  scries  to  M terms  in  our  vector  space 
representation.  It  is  speculated  that  a more  reasonable  approach  is  to  b<uind  the 
error  probability  for  our  receiver  and  determine  how  these  bounds  behave  as  a 
function  of  the  delay  t (incorrect  estimates  of  tearing)  and  of  the  correlation 
Ix'tween  channels  (diagonal  versus  non-diagonal  noise  covariance  matrices). 
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APPKNDIX:  THE  C’OKRELATION  BETWEEN  FOl'RIER  COEFFICIENTS 


Let  the  signal  on  channel  i be  a sample  function,  r-(9.t)  ISeQl  ft*"!'  a wide- 

sense  stationary,  zero-mean  random  process.  Now,  supix)se’  the  signal  is  expaixled 
on  a finite  interval  -T  '2  t T/2  in  a Fourier  series; 


where 


rjie.t)-  ^ X|(nco„,0)e)"“o* 

n •-'V 


(.A-l) 


(.\-2) 


X (nco,,.9)  ~ TT  _ p (0  j)p-jncOotjj( 

1 0 j J . 

Different  sample  functions  r|(6,t>  yield  in  general  dilferent  values  X|(nu„,e) 
since  the  process  is  random.  Thus,  the  Fourier  ctx'fficient  X|(ncO(,>  is  a random 
variable  and  XjlncoQ.S)  is  the  value  the  random  variable  takes  on  (Vtr  all  9e©. 

With  this  distinction,  and  knowledge  that  ex[jectation  ElX^tncoj,)!  i.s  with  respect 
to  all  sample  points  de  o.  the  specific  notation  of  6 will  lie  dropix'd. 

For  the  calculations  shown  in  simplifying  the  likelih<x)d  ratio  it  was 
extremely  convenient  for  the  p'ourier  ciH'fl'icients  defined  by  Eq.  .A-.'!  to  have  the 
proiK'rty  that  they  l)c  uncorrelated 

F’.  !X|(ncO(,)X*  (mco,))i  - (t  n/m  (.A-A) 

for  all  i,  j and  n/m.  To  see  if  this  is  so  for  a zero-mean,  stationary  process,  some 
identities  must  first  be  developed.  From  F]q.  .A-;!, 

yXt'2 

Taking  the  complex  conjugate  of  both  sides, 

1 r T /2 

X-*(ncOf,)  — / r * (f  )e  ‘ j'’“o§  d§ 

' " T X.T/2  ' 

multiplying  by  r^tt)  and  taking  the  expectation 

Elrj(t)  X*(nco„)|  J Elr/Dr*  (^)ie (A-7) 


(.A-.o) 


(.A-(i) 


*W«*  MHHumr  that  tha  procrsH  can  he  n prcsentecl  in  the  mcan-siiuare  sense  by  the  Kouner 
senes.  As  will  b«*  shown,  this  rt‘()uires  that  the  proet*ss  be  periodic  or  that  the  record 
length  be  infinite. 


reducos  to 


Etr  (t)  X*(noo,,)l  rlr  f " K <t,ne  ' )''“oC  (A-H) 

J I u I J .p  IJ 

Since  the  [wocess  is  stationary,  R|j(t,5)  is  a function  only  of  t § t.  Making  this 
substitution,  .A-8  l)econK?s 

Etr  (t)  X,*  (nco,,)i  f R .(  T)e‘ t)  (A-9a) 

) I ” 1 J^.'['/2 


e 

R (Tie T»d(-T)l 

(.A-9b) 

1 

Tj 

t‘T,'2 

1 

e*  j"  “o‘ 

rt*T'2 

/ R (lie  dr 

(A-9c) 

It  j 

ft-T/2 

The  bracket  term  is  recognized  as  the  Fourier  transform  of  the  cross-correlation 
function,  which  would  be  identical  to  the  cross-spectral  density  if  it  were  not  for 
the  variable  t in  the  limits  of  integration.  To  eliminate  the  variable  t,  we  can 
choose  Rij(T»T)=  RjjlT);  let  the  process  be  periodic.  In  this  instance,  the  integral 
over  a period  T taken  at  any  time  t will  be  the  same  and  A-9c  reduces  to 

Etrj(t)  X*  (ncoo)!  e ' j"“o<  (I).  .(nco„)  (A-lOa) 

where 

<h.(ncOf.)=^  R..(T)e-i"“of  dT  . (.A-U)b) 

‘J  0 T J-T/2 

To  avoid  assuming  a periodic  process,  simplification  of  Eq.  .A-9c  can  be 
handled  by  letting  T become  large.  Multiplying  both  sides  of  Eq.  .A-9c  by  T 

TElr(t)X.*(ncon)|  = -e-i"“o‘  R..(T)e-i''“of  dr  (A-11) 

) 1 u jt-T/2  ' 

Papoulis^  shows  that  by  considering  a large  T an  error  £(t,T)  is  committed  which 
tends  to  zero  as  T-»-<-. 

TE  Ir-(t)  Xj*  (iicoq)!  - e I"""*  ^'jjtncoQ)  - E(t,T)  (A-12a) 


where 


d>jj(nK)) 


Rjjtrle 


(A-12b) 


‘I'rohahil ity,  Hamlom  Variables  and  Stachaslic  Processes.  A.  Piipoulis.  McGrawHill, 
New  York.  ItHi.'i.  pp.454-4iiK. 


r 


With  tlu‘  ri'siilts  of  Ki|s.  A 10.  and  .\  12.  it  will  1k‘  i)ossil)lo  to  examine 
Kq.  .\-4.  Kroni  Kc].  .A-.l. 


X|(ntcO|)) 


f ' r (fit'  )"'"o§d^  . 

I ./  r 2 ' 


<.\  l.'O 


'I'aking  the  complex  conjuKate,  multiplying  by  .X-(ncO(j).  and  taking  the  ex|H‘ctation 

E tX-(ncoQ)Xj*  (mcO(^)|  ~ J ^ ^ E !Xdnco,))rj*  (^)le')"'“o§  d^  (.A-M) 

The  term  E lX|(ncO())r-*  (^)i  is  identical  to  the  complex  conjugate  of  Kq.  .\-10a  with 
t replaced  by  wten  R,j(T)  is  periixiic.  Substituting. 

E IX-(iico„)X*  (mco„)|  ^ j ' e J»“o5<|>  *(nco„>e  jmwoS  d<;  (A-ir>a> 


f ' “ <1>.  *(nco,,)e‘ de 
T./  T 2 ''  " 

0..*  (nco,,)  — I ' “ e 
ij  " T ./  T 2 


(.A-l.^b) 


( .A- 1 .Ac  > 


The  integral  is  identical  to  zero  for  m/n  and  Eq.  A-lAc  can  be  written  as 

<J>  (iicoq)  m n 

E|X-(mco„)X.*  (nco,,)i  (.A-1 

‘ " 0 m,/n 

after  taking  the  complex  conjugate.  Thus,  for  a periodic  ptx)ccss.  the  Fourier 
coefficients  are  uncorrelated. 

When  the  process  is  not  |3eri(xiic.  Eq.  A-14  must  be  considered  in  the  limit 
as  T By  taking  the  complex  conjugate  of  Eq.  A-12a. 


EIXj(ncoQ)r*  (t)i 


T ' T 


Substituting  into  Eq.  .A-14  after  a change  of  variable  from  t to  ^ gives 


TEIXj(ncOjj)X*  (nc0|j)|  


<tr»(nco„) 


f ' ^ nlco„f  (jc 

I V 2 


I f r 


(.A-lH) 


Croni  whii'h  we  conclude' 


lim 
T .- 


TF,  lX|(nico,|>X*  (ncO(,)| 


<l>,/nco„) 

0 


ni  I) 
ni/ii 


<A-1») 


'rhus.  we  may  conclude*  that  the  Fourier  coelTicients  art*  uncorrelated  (Fq.  A-4 
holds)  only  when  (1)  the  prtK'ess  is  pt>riodic  or  (2)  when  the  observation  interval 
becomes  infinite. 


pp.456 


A-4 


